Reliably Evaluating Summaries of Twitter Timelines
نویسندگان
چکیده
The primary view of the Twitter social network service for most users is the timeline, a heterogenous, reversechronological list of posts from all connected authors. Previous tweet ranking and summarisation work has heavily relied on retweets as a gold standard for evaluation. This paper first argues that this is unsatisfactory, since retweets only account for certain kinds of post relevance. The focus of the paper is on designing a user study, through which to create a gold standard for evaluating automatically generated summaries of personal
منابع مشابه
A ranking approach to summarising Twitter home timelines
The rise of social media services has changed the ways in which users can communicate and consume content online. Whilst online social networks allow for fast and convenient delivery of knowledge, users are prone to information overload when too much information is presented for them to read and process. Automatic text summarisation is a tool to help mitigate information overload. In automatic ...
متن کاملA Methodology for Evaluating Timeline Generation Algorithms based on Deep Semantic Units
Timeline generation is a summarisation task which transforms a narrative, roughly chronological input text into a set of timestamped summary sentences, each expressing an atomic historical event. We present a methodology for evaluating systems which create such timelines, based on a novel corpus consisting of 36 humancreated timelines. Our evaluation relies on deep semantic units which we call ...
متن کاملSocially-Informed Timeline Generation for Complex Events
Existing timeline generation systems for complex events consider only information from traditional media, ignoring the rich social context provided by user-generated content that reveals representative public interests or insightful opinions. We instead aim to generate socially-informed timelines that contain both news article summaries and selected user comments. We present an optimization fra...
متن کاملBetter Twitter Summaries?
This paper describes an approach to improve summaries for a collection of Twitter posts created using the Phrase Reinforcement (PR) Algorithm (Sharifi et al., 2010a). The PR algorithm often generates summaries with excess text and noisy speech. We parse these summaries using a dependency parser and use the dependencies to eliminate some of the excess text and build better-formed summaries. We c...
متن کاملA Participant-based Approach for Event Summarization Using Twitter Streams
Twitter offers an unprecedented advantage on live reporting of the events happening around the world. However, summarizing the Twitter event has been a challenging task that was not fully explored in the past. In this paper, we propose a participant-based event summarization approach that “zooms-in” the Twitter event streams to the participant level, detects the important sub-events associated ...
متن کامل